Behavior of Lasso Quantile Regression with Small Sample Sizes
ثبت نشده
چکیده
Quantile regression is a statistical technique intended to estimate, and conduct inference about the conditional quantile functions. Just as the classical linear regression methods estimate models for conditional mean function, quantile regression offers a mechanism for estimating models for conditional median function, and the full range of other conditional quantile functions. In this paper describe, compare, and apply the two quantile regression (L1-Lasso, L2-Lasso) suggested approaches. The two quantile regression suggested approaches used to select the best subset of variables and estimate the parameters of the quantile regression equation when small sample sizes are used. The aim of this study is to study the behavior of L1Lasso and L2 -Lasso quantile regression method when small sample sizes are generated. Simulations show that the proposed approaches are very competitive in terms of variable selection, estimation accuracy and efficient when small sample sizes are used. All results showed superiority of L1 -Lasso compared with L2 -Lasso linear programming methods. Keywords—Quantile Regression – Small Sample size – Selection of Variables estimated risk – relative estimated risk.
منابع مشابه
Bayesian Quantile Regression with Adaptive Lasso Penalty for Dynamic Panel Data
Dynamic panel data models include the important part of medicine, social and economic studies. Existence of the lagged dependent variable as an explanatory variable is a sensible trait of these models. The estimation problem of these models arises from the correlation between the lagged depended variable and the current disturbance. Recently, quantile regression to analyze dynamic pa...
متن کاملA New Family of Error Distributions for Bayesian Quantile Regression
We propose a new family of error distributions for model-based quantile regression, which is constructed through a structured mixture of normal distributions. The construction enables fixing specific percentiles of the distribution while, at the same time, allowing for varying mode, skewness and tail behavior. It thus overcomes the severe limitation of the asymmetric Laplace distribution – the ...
متن کاملEstimation of high dimensional mean regression in the absence of symmetry and light tail assumptions.
Data subject to heavy-tailed errors are commonly encountered in various scientific fields. To address this problem, procedures based on quantile regression and Least Absolute Deviation (LAD) regression have been developed in recent years. These methods essentially estimate the conditional median (or quantile) function. They can be very different from the conditional mean functions, especially w...
متن کاملAdaptive Robust Variable Selection.
Heavy-tailed high-dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. A natural procedure to address this problem is to use penalized quantile regression with weighted L1-penalty, called weighted robust Lasso (WR-Lasso), in which weights are introduced to ameliorate the bias problem induced by the L1-penalty. In the ul...
متن کاملThe quantile process under random censoring
In this paper we discuss the asymptotical properties of quantile processes under random censoring. In contrast to most work in this area we prove weak convergence of an appropriately standardized quantile process under the assumption that the quantile regression model is only linear in the region, where the process is investigated. Additionally, we also discuss properties of the quantile proces...
متن کامل